Skip to content

Add model overrides and Mittwald route#761

Closed
CONN-SKILL wants to merge 1 commit into
PurpleAILAB:mainfrom
CONN-SKILL:model-overrides-mittwald
Closed

Add model overrides and Mittwald route#761
CONN-SKILL wants to merge 1 commit into
PurpleAILAB:mainfrom
CONN-SKILL:model-overrides-mittwald

Conversation

@CONN-SKILL

Copy link
Copy Markdown

Adds engagement-level model overrides, exposes model selection in the web UI, wires overrides through the terminal/CLI LangGraph run config, and adds dynamic LiteLLM support for Mittwald AI Hosting via MITTWALD_AI_BASE_URL / MITTWALD_AI_MODEL.\n\nRuntime verified locally with Docker: web/langgraph/litellm healthy and mittwald/Mistral-Medium-3.5-128B returns OK through LiteLLM.

@CONN-SKILL
CONN-SKILL requested a review from PurpleCHOIms as a code owner July 8, 2026 10:50
@CONN-SKILL
CONN-SKILL force-pushed the model-overrides-mittwald branch 8 times, most recently from b66fd59 to 1aab3e6 Compare July 8, 2026 18:54
@PurpleCHOIms

Copy link
Copy Markdown
Member

Thanks — engagement-level model overrides and the Mittwald route are both wanted. This needs a rebase + cleanup before it can land, though:

  1. Conflicts with main / overlaps already-merged work. Since this PR was opened, per-role model override landed via the existing model_override middleware (feat(llm): modular per-role model override + MID→Sonnet 5 #762) and per-role composition via PluginBundle.models + env (feat(llm): compose per-role model via PluginBundle.models + env override #767). This PR also adds middleware/model_override.py and edits middleware_slots.py, so it now conflicts and partly duplicates what's on main. Please rebase onto current main and reconcile against the merged middleware rather than reintroducing a parallel path.
  2. Duplicate Prisma migration. There are two migrations for the same feature — 20260708120000_add_engagement_model_override and 20260708153000_add_engagement_model_overrides. Collapse to one.
  3. Please split the transport/egress bits out. The Mittwald LiteLLM route (litellm_dynamic_config.py, .env.example) and the Mullvad egress work (docker-compose.mullvad.yml, docker-compose.lan.yml, docs/ops/mullvad-sandbox-egress.md) are unrelated to the model-override UI and touch CODEOWNERS-protected compose files. Landing them as their own small PR will get each through review much faster.
  4. No CI has run on this branch yet — once rebased, please confirm make quality + the web lane are green locally (this touches clients/web schema + API routes).

Leaving open for the rebase. Ping me when it's split and green and I'll review promptly.

Adds engagement-scoped model override middleware, web UI model selection, CLI/LangGraph run-config wiring, per-agent routing UI, and a configurable model block policy.

Per review, the transport/egress bits (Mullvad sandbox overlay, LAN compose, Mittwald LiteLLM route) are split out of this PR and will be submitted separately.
@CONN-SKILL
CONN-SKILL force-pushed the model-overrides-mittwald branch from 6637a40 to ed0c8eb Compare July 12, 2026 21:22
@CONN-SKILL CONN-SKILL closed this Jul 12, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants